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SYSTEM  AVAILABILITY:  TIME  DEPENDENCE  AND  STATISTICAL  INFERENCE 

BY  (SEMI ) NON -PARAMETRIC  METHODS. 

D . P .  Gave  r 
P.A.  Jacobs 

1.  INTRODUCTION. 

Component  or  system  ava i I ab i I i ty  generally  refers  to  (a)  the 
probability  that  the  item  of  concern  is  operable  or  ”  up”  and  mission- 
capable  at  a  point  or  during  a  period  of  time,  or  to  (b)  the  fraction 
of  time,  or  of  demands  if  the  item  is  on  standby,  for  which  the  system 
is  up.  Applied  to  large  systems  such  as  entire  U.S.  Navy  ships,  system 
availability  is  referred  to  as  read i ness .  At  a  different  level,  the 
availability  and  f au 1 1- to  1 e ranee  of  computer  systems,  both  government 
and  commercial,  is  of  concern,  and  has  recently  been  extensively 
modelled  and  simulated;  see  Goyal ,  Lavenberg  and  Trive  di1.  The 
availability  concept  is  also  relevant  when  discussing  the  safety  and 
productivity  of  commercial  nuclear  power  plants;  in  that  arena  it  is 
quantified  by  probabilistic  risk  assessment  (PRA) .  Related  finite 

n 

state  stochastic  models  also  occur  in  medical  studies;  c.f.  Cox^  , 

J  acobs  . 

Component  or  system  availability  is  influenced  both  by  the 
inherent  f a  i  1 u re - proneness  of  the  item  and  by  the  time  and  resources  it 
takes  to  restore  a  failed  item  to  service.  Times  to  failure  or  "up 
times"and  to  restoration  or  "down"  times  may  vary  considerably,  and  not 
necessarily  independently,  depending  upon  the  mode  of  failure,  the  time 
required  to  diagnose  the  failure  including  the  access  to  (including 
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competition  for)  diagnostic  equipment  and  human  skills,  the 
availability  of  spare  parts  (logistic  delays),  and  other  factors.  It 
is  also  quite  conceivable  that  the  quality  of  the  repair  activity 
influences  future  times  to  failure.  This  effect  is  not  recognized  by 
the  usual  models;  but  see  Gaver^  (p p.  775-800) ,  and  Thomas,  Jacobs  and 
Gave  r° .  Incorporation  of  ’’availability  growth”  in  availability 
situations  is  a  practical  issue  that  is  not  frequently  modelled;  see 
our  Section  2  below,  hewever. 

T-he  present:  paper  addresses  the  assessment  of  simple  system 
availability  when  there  is  concern  about  (a)  time-dependence,  so 
demands  for  system  performance  are  not  necessarily  when  the  system  is 
in  ’’steady-state,”  as  is  often  assumed,  and  when  (b)  information  about 
system  failures  and  repairs  is  in  the  form  of  observed  data  so 
questions  of  statistical  influence  arise.  The  methods  and  models 
involved  lean  towards  the  sem i - paramet r i c  or  non- paramet r i c ;  in 
particular  we  employ  the  empirical  Laplace  transform  in  the  time- 
dependent  scenarios  of  interest)  non -paramet r i c  estimation  in  assumed 
steady-state  situations  has  been  studied  by  Gaver  and  Chu^ .  Other 
investigations,  e.g.  Cox  ,  Gross  and  Harris  and  Ascher  and  Feingold 
have  been  overwhelmingly  concerned  with  estimation  in  presumably  we  1  1  - 
specified  stochastic  (queueing,  Markov)  models;  considerations  of  model 
m i s - spec i f i cat i on  are  seldom  broached.  Here  we  propose  analytically 
simple  approximations  to  time-dependent  system  behavior,  and  assess  the 
effects  of  model  specification  ("up"  and  "'down"  time  dependence)  upon 
rates  of  approach  to  a  long-run  steady  state  as  the  latter  are 
estimated  from  available  data  (assumed  to  be  a  random  sample) . 


Incertainty  assessments  (confidence  limits  and  standard  errors)  are 


f  u  rn i shed . 


More  elaborate  procedures  involving  Bayes  or  empirical 


Bayes  setups  that  permit  ’’strength  borrowing”  (in  John  Tukey’s  phrase) 
are  not  addressed  here,  but  are  agenda,  items. 

Our  paper’s  plan  is  as  follows.  Section  2  describes  a  selected 
group  of  probability  models  for  simple  system  availability;  no 
comprehensiveness  is  claimed.  Solutions  are  given  in  terms  of  Laplace 
transforms,  all  of  which  are  rendered  immediately  i nte rpretab 1 e  in 
terms  of  the  random-t  ime-of -demand  or  observation  parad.orr.,  described 
originally  and  applied  to  transform  inversion  in  Gaver^® .  Section  3 
describes  and  ’’fits”  the  simple  exponent i  al  -  approach-to-steady-state 
model  used  for  representing  time-dependent  behavior;  see  Odon i  and 

tO  t  -I 

Roth  and  Gaver  and  Jacobs  where  such  an  idea  was  used  to  represent 
time-dependent  queueing  behavior.  Section  4  introduces  issues  of 
estimating  time-dependent  availability  where  only  statistical  data  is 
at  hand.  Section  5  presents  a  variety  of  numerical  illustrations. 
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2.  TIME-DEPENDENT  AVAILABILITY:  MODELS,  TRANSFORMS,  AND  THE  RANDOM 
OBSERVATION  (ROBS)  INTERPRETATION. 

Consider  a  system  that  is  active  or  operative  ("up" )  until  failure 
occurs,  after  which  a  "down”  period  occurs,  at  the  termination  of  which 
a  new  up  period  begins,  and  so  on.  Suppose  the  system  is  to  be 
responsive  to  a  randomly  appearing  demand;  what  is  the  probability  that 
it  will  respond  properly,  or  be  available,  at  the  time  of  the  demand? 

I n  the  military  arena  the  device  might  be  a  surveillance  (radar,  sonar) 
or  communications  system.  In  the  commercial  nuclear  power  context  it 
might  be  a  coolant  pump. 

There  are  many  versions  of  this  problem.  The  simplest  and  most 
traditional  imagines  that  the  system  operates  continually  between 
failures,  and  failure  is  instantly  detected  upon  occurrence.  Up  times 
may  be  modelled  as  iid  random  variables,  either  directly  or  indirectly. 
If  the  system  is  redundant  a  new  up  time  begins  at  the  instant  an  old 
one  terminates,  with  repair  off-line.  Down  times  may  also  be  iid. 
However,  there  are  many  plausible  exceptions  to  these  scenarios,  a  few 
of  which  are  considered  next. 

Here  are  various  sample  model  formulations;  the  1 i st  is  by  no 
means  complete.  In  all  of  these  the  system  is  up  at  t  =  0; 
modifications  are  straightforward. 

Model  1:  ud  times  are  iid  -f  Uj  T  .  with  df  Fu(  x) ;  down  times  are  i id 
{Dj}  .  d.f.  FD(y).  A(t)  =  P{System  up  at  t  |  up  time  starting  at  t  =  0}. 
Then,  by  a  simple  backward  renewal  argument.  A(t)  satisfies  the 
integral  equ  at i o  n 


A  ( t  ) 


Fu(t)  + 


t 

A  (  t-v)  Fc  (civ) 

0 


(2.1) 
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where  Fc(t)  =  Fu*FD(t) ,  the  convolution.  Laplace-transforming, 


A(S)  =  f°°  e"st  A  ( t )  d  t  =  \  ~  ^U(S) 

J0  s[l  -  Fc  (s)  ] 


(2.2) 


IF  the  item  is  observed  or  demanded  at  random  time  T  ~  exp(s)  then 


E[A(T)]  =  r  se"st  A  ( t )  d  t  =  j— 
Jn  1  ~ 


(2.3) 


and  since  E  [T_J  —  1/s  =  r,  the  probability  of  being  up  upon  demand  is 


a0(r)  =  E[A(T)]  = 


1  -  Eu(r-1) 
1  -  Fc  (  r’1 ) 


(2.4) 


E[U]  _  E[U] 

E[C]  E[U]  +  E  [D] 


(2.5) 


by  Taubo  r  i  an/Abe )  ian  results;  see  Feller  (1966).  One  can  view  (2.4)  as 
the  ava i 1 ab i 1 i ty  under  random  demand  or  observation;  ROBS  for  short. 

To  emphasize  the  fact  that  exponential  random  observation  is  involved 
we  util ize  EROBS .  The  last  formula,  written  here  as 


,  \  E[U] 

a°<oo)  -  k[C]  nm 


(2.6) 


is  the  widely-applied  long-run  availability.  It  may  well  be  inappro¬ 
priate  in  many  of  the  contexts  in  which  it  is  appl i ed . 

Note,  though,  that 


'  -  Fuiii) 

"°<r>  -  1  -  i>c(r-) 


(2.7) 


has  a  definite  interpretation  for  al 1  r.  It  is  usually  easily  computed 
and  interpreted  whenever  transforms  of  U  and  D  (or  C)  exist.  As  will 
be  seen,  it  can  be  estimated  from  data  under  many  circumstances — even 
when  the  model  selected  has  either  E  [U]  or  E  [D]  infinite  and  (2.6) 
becomes  uninteresting. 

Here  are  several  additional  models  whose  transforms  can  be 
directly  written  down,  and  directly  interpreted  under  EROBS  demands. 

Mode  1  2 :  The  initial  up  time  U0  has  df  Fy^ ;  {Dj  +  U|  =  Cj , 

i  =  1,2,...}  are  iid  and  i nde pendent  of  U0 .  This  attempts  to  mode  1  a 
situation  in  which  the  quality  of  maintenance  during  a  down  time 
affects  the  distribution  of  the  next  up  time,  so  these  times  are 
dependent;  the  influence  stops  at  that  point,  however.  Let  AD(t)  = 
P{svstem  not  up  (down)  at  t | down  time  starts  at  t  =  0}.  Then 


aD  ( t ) 


FD(t)  + 


ft 

0 


AD(t-r)FC^r) 


and 


A  ( t ) 


1  if  U0  >  t  , 

Aj-)(t-U0)  =  1  -  AD(t-U0)  if  U0  <  t 


so 


A(t)  =  FUq ( t )  + 


ad ( ^  _ 1 ) 3  Fu0 ( d  r )  =  1 


ft 

0 


AD(t-r)Fu0(dr)  . 


Transforming  gives 


A  (s) 


(2.8) 


1  -  Fc(s)  -  FUo(s)  +  FUo(s)Fd(S) 
1  -  Fc(s) 


from  which  the  observational  probability  a0(r)  can  be  immediately 
written  down:  a0(r)  =  r1A(r1).  Models  that  propose  that  the  up  time 

can  positively  influence  the  duration  of  the  following  down  time  have 
been  formulated;  see  Gaver^ . 

Model  3:  (Random  changepoint  model;  ’’reliability  growth”).  Suppose 

the  system  fails  according  to  up  times  {U(1  .  i  =  1,2,...  I},  iid  F,(u) 
and  thereafter  {Uj2  ,  i  =  1  +  1  ,  1+2 ,...},  iid  F2(u);  I  ~  p(  i  s  the  change- 
point  and  is  associated  with  d i agnost i c - repa i r  activity.  Let  FD ( u ) 
describe  the  iid  down  times  (D|  ,  i  -  1,2,...}.  Suppose  the  system 

starts  operation  as  a  Type  1  up  time,  transitioning  after  a  random 
number  of  down  times  to  Type  2.  Let  Alj(t)  denote  the  probability  that 
the  system  is  up  and  in  state  j  at  time  t  given  it  is  up  at  time  0, 
i.e.  t  is  contained  in  an  up  time  of  Type  j.  Then,  using  backward 
renewal  arguments. 


A 1 1  ( t:  ) 


Fiu(t)  +  O-Pj.) 


ft 

0 


An  (t-r)Fxc(dr) 


a22 ( t ) 


and 


F 2U  (  A  ) 


A22(t-r)F?c(dr)  • 


A 1 2  (  t  ) 


A22(t-r)G(dr)  » 

0 


(2.9) 


where 


a  (  r  1 


=  £  PiFir(r)  : 


as  before  Fjc(r)  ref  or  s  to  the  df  of  a  cycle  time  UJ(  +  Dj  .  Transforming 
immediately  produces  a  solution: 


An  (s)  = 


1  -  F1L,(s) 

1  -  (l-p^Fjcfs) 


A?2  (  s  )  — 


-  1  1  ~  ^2U ( s  ) 


1  -  F2c(s) 


(2.10) 


A 12  (  » )  —  A22G  (  s ) 


G(»)  =  E  P^'icC®))'  =  p(r'’ic(s))  ’ 


tli  is  last  being  the  generating  function  of  the  number  of  repairs  to 
transit  ion  r-s-  ,  1  .  Assemble  to  obtain  the  transform  of  the  probability 
of  being  up  at  t  : 


A  i  (  s  )  _  e  [  A  j  j  (  t  )  +  A  j  2  (  t  )  ]  <1 1  —  Ajj  (?)  +  A  1 2  (s  ) 

J0 


1  - 

1  -  (  1  -  Pi )  F1C  («) 


+  p(f1c(®))  '  { 


1  ~  2  U  (  s  ) 

1  -  f2c(^) 


(2.11) 


CoiiseqiK'nt  1  y  t  h.e  obsei'vat  ional  probabi  1  i  ty 


a0(r)  =  K [A ( T  )  ]  = 


tfuilA) 


-  (  1  -  1*1  )  ^  1C  (  l/r) 


—  +  p( ^  1 c ( >A)) 


F2u(l/r) 

f'2C(  J/r) 


(2.1 2 ) 


K[r2]  +  i:[D] 


a.^  T  — 1 ►  X' 


S 


but  the  latter  limiting  formula  provides  no  information  about  the 
availability  at  early  times,  possibly  before  change  has  taken  place. 
The  EROBS  random  demand  formulation  at  least  allows  some  informat  ion  to 
be  obtained  in  a  very  direct  and  meaningful  manner  by  just  evaluat  i ng 
the  transform  itself  numerically. 

Mod  el  4 :  (Markovian  changepo i nts)  .  It  is  possible  that  a  system 

alternates  slowly  between  failure  states,  either  temporarily'  or 
forever.  The  random  motion  may  be  in  response  to  occasional  changes  in 
maintenance  practices,  to  debugging  (reliability  growth),  or  to  ageing 
(reliability  decay)  and  subsequent  replacement.  To  illustrate,  let 
there  be  just  two  failure  distribution  states,  as  in  Model  3,  but  let 
{Pij  ;  i,j  =  1,2}  be  the  transition  probabilities  of  a  Markov  chain  that 
governs  jumps  between  them.  Suppose  the  system  starts  in  state  1 .  at 
the  beginning  of  an  up  time  ~  Fjtj(r),  '  =  1  '  2  •  Then,  letting  A- ( t  ) 

be  the  probabil  ity  the  system  is  up  and  in  state  j  at  time'  t  given  it 
just  started  an  up  time  at  time  0  and  was  in  state  i , 


Au(t)  -  F10(t)  +  P  x  i  Aj  j  ( t- r )  F1C  (d  r )  +  p12 

J0 


A21  (t-r)  F1C  (dr)  , 


Ai2(f)  -  Pi 2 


A22  (t-r)Flc(dr)  +  pu  [  A12  ( t r  )  F1C  (d  r  )  . 

0  JD 


(2.13) 


A  2  2  ( 1  )  —  F2u(t)  +  p22  f  A22(t-r)f2(-(dr)  +  p21  i  A12(t-r)f2(-(di 

J0  J0 


rl 


A 2 1  ( 1  )  -  P2i 


Au  ( 1  -r  )  F2C  (dr)  +  P22  A21(t.-r)F2C(dij  . 

0  J0 
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Transforming  yields  these  equations. 


(2. 14, a) 


An(s)  =  - ^Lg~ —  +  PiiAh(s)F1c(s)  +  p12\21(s)Flc(s) 

A12(s)  =  p12A22(s)Flc(s)  +  PllA12(s)Flc(s) 

A22  (  s  )  =  -  +  P22A22  (s)  ^2C  (s)  +  P21A12  (s)  ^2C  (s) 

A2i(s)  =  p21Au(s)F2C(s)  +  p22A21(s)F2C(s)  . 


Solve  (2. 14, a)  and  (2.14,d)  simultaneously  to  get 


An  (s) 


_ 1  ~  Fiu(s) _ 

1  -  Pll^lcO)  -  Pi2P2iF'ic(s)P'2c(s)/(1-P22F'2c(s)) 


F rom  (2 . 14b , c )  , 


1  ~P22^2C  (s  )  -  P21P12F1C  (s)  ^20  (s)/(1  “Pilule  (s)) 

(  p12^ic(s)  \ 

^-PuF'ic  (s)' 


It  follows  that  if  r  =  1/s, 


(r)  =  sAu  =  s[Au(s)  +  A12(s)] 


_ 1  -  FiuO) _ _ 

[1-Pll^lc(s)-Pl2P2lf'lc(s)F’2c(s)/(1-P22F'2c(s)J 

+  _ 1  ~  p2ll(s) _ 

J“P22p2c(3)“Pl2P2lflc(3)l‘2cC3)/(1_Pll^lC^S)) 

/  p12Flc(s)  x 
^-PnFic(s) 


1 0 


(2. 14, b) 

(2. 14, c) 

C2 . 14  .d) 

(2.15) 

(2.16) 


(2.17) 


The  above  formula,  is  manifestly  opaque  as  it  stands. 


Tau  be  r i an / 


Abelian  results  present  the  long-run  behavior: 


all  (<») 


1  i  m  sA , .  (s ) 
s  — *  0  11 


_ ECU!] _ 

E[Cq]  +  (  P12/P21 )  E  [Cj] 


(2.18) 


and 


al2 (°°) 


_ E[U2] _ 

E  [C2]  +  (  P21/P12 )  E  [Cj] 


(2.19) 


so  the  sum 


E[Uj] 


q(oo)  au(oo)  +  a12(oo)  -  E[Cl]  +  ( p12/p21 )  E  [C2]  +  E[C2]  + 


E[U2] 


(P2l/pl2)E[C1] 

(2.20) 


represents  the  long-run  probability  that  the  system  is  up.  Of  coirse 
a1(r)  for  r  finite  is  available  from  (2.17)  and  potentially  provide 
considerably  more  information. 

Many  other  such  models  can  be  constructed  and  "solved”  by 
transforms.  In  what  follows  we  illustrate  the  way  in  which  such 
transform  solutions  can  be  exploited  to  yield  time-dependent  and 
inferential  information.  The  intention  is  to  provide  simple  and 
flexible  approximate  information  rather  than  to  utilize  more  exact,  but 
also  more  computationally  demanding,  procedures. 


I 


3. 


TIME-DEPENDENT  AVAILABILITY  AT  FIXED  OBSERVATION  TIMES  (FOBS) : 
SIMPLE  EXPONENTIAL  REPRESENTATIONS. 


It  is  familiar  from  the  theory  of  finite  Markov  chains  and  also 
from  renewal  theory  that  if  a  long-run  or  steady-state  condition  is 
reached  by  a  stochastic  model ,  then  the  nature  of  the  approach  is  often 
essentially  exponential.  In  particular,  if,  in  Model  1,  U  ~  exp(A), 

D  ~  exp(/i)  then  for  A(0)  =  1, 


A  ( t ) 


A*  ,  A  -(A+/i)t 
A  -f  fi  A  -f  n 


(3.1) 


Such  a  time  dependence  is  exhibited  approximate  1 y  by  the  M/G/l  queue; 
see  Odoni  and  Roth^;  Morse^’^,  and  later  Kielson'^.  and  others  have 
assessed  the  relaxation  times  of  various  queueing  systems.  See  also 
Gaver  and  Jacobs^  for  a  brief  discussion  of  the  time-dependent  M/G/l 
queue  utilizing  such  a  representation. 

It  is  we  1 1 -understood  that  natural  generalizations  of  the  Markov 
formulation  producing  (3.1)  can,  for  certain  models,  lead  to  damped 
oscillatory  approach  to  a  steady-state  value  a(oo),  or  to  ultimate 
approach  that  is  exponential  modified  by  a  negative  power  of  t. 
However,  in  what  follows  we  shall  assume  that  the  ’’error”  at  time  t  is 
approximately  exponential: 


e  ( t )  =  A  ( t )  -  A  (  oo ) 


-ii  t 
ne 


(3. 2. a) 


or.  more  elaborately. 


.  ,  -(r+i(?)t  ,  .  N  -(r-ifl)t 

-  (Oi+l'b)0  +  (°f-lf*2)e 


(  3 . 2  .  b ) 


and  investigate  ways  of  assessing  parameter  values  ■from  (a)  perfectly 


spec i f i ed  mode  Is,  whe  re  in  the  distributions  of  U,  D  are  presumed  known , 
and  (b)  from  data.  This  section  deals  with  problem  (a) . 

The  motivation  for  considering  simple  exponential  model  (3.2)  is 
the  desire  for  an  easily  comprehended  and  computed  assessment  of  time- 
dependent  availability  at  a  f i xed  demand  or  observation  time 
(abbreviated  FOBS).  In  many  cases  encountered  such  an  assessment  (or 
assessments)  of  a  and  /?  or  of  cq  ,  a2 ,  r  and  6  can  provide  a  useful  sense 
of  the  behavior  of  A(t)  as  time  progresses  without  the  necessity  of  an 
extremely  time-consuming  and  compute r- i ntens i ve  transform  inversion 
procedure  or  of  a  symbolic  inversion  in  terms  of  polynomial  roots;  the 
latter  is  ’’explicit,”  but  hardly  comprehensible  in  general. 

Simulations  and  numerical  solutions  of  governing  integral  equations  are 
also  useful  approaches,  but  they  are  generally  more  computationally 
intensive  than  our  proposals  here. 

We  suggest  several  ways  of  matching  an  exponential  to  A(t)  by 
utilizing  the  transform  A(s),  presumed  given. 

3.1  Method  1:  Least  Squares,  Unweighted  and  Weighted  (’’Tuned”) 

Begin  by  considering  (3. 2, a).  If 


e(t)  =  A(t)  -  A(oo); 


(3.3) 


we  wish  to  represent  this  ’’error”  by  e(t) 


oe 


Cons i de  r 


A  (  ft  ,  )3  ) 


(3.4) 
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the  integrated  squared  error;  the  object  is  to  minimize  A  by  choice  of 
a  and  /? .  Differentiation  on  a  easily  gives  the  optimizing  condition 


=  2(3  f  e(t)e'/?tdt  =  2/?e(/J)  -  2/?[a  (/?)  - 


(3.5) 


i.e.  a0  is  evaluated  in  terms  of  the  known  Laplace  ■*" rnnsf orm  of  A(t) 
and  of  e(t),  evaluated  at  (3.  To  find  a  minimizing  (3  it  is  possible  to 
proceed  by  squaring  the  integrand  of  (3.4),  discarding  the  e2(t)  part, 
and  substituting  a0  for  a.  Simplification  leads  to 


-A(«0  (/?),/?)  =  A  (13)  =  -2/?[e(/f)]2 


(3.6) 


which  can  be  readily  searched  for  a  global  maximum,  (3Q.  It  is  easily 
verified  analytically  that  if  U  ~  exp(A),  D  ~  exp (g)  in  Model  1  then 
(30  =  X  +  n,  as  it  should.  In  general  the  search  of  (3.6)  must  be 
conducted  numerically. 

The  straightforward  least-squares  procedure  can  be  tuned  towards 
different  time  ranges  by  appropriate  weighting.  We  may  seek  to 
min i m i z  e 


A  (  a  ,  /?  ;  w  ) 


r  (2 

(e(t)-are  M2w(t;r)dt 

J0  v  ' 


(3.7) 


whe  re 


w  ( t  ;  r  ) 


near  r 


0  far  from  r. 


(3.8) 


Then  the  minimizing  a  and  /?  values,  now  a0(r)  ,  0q{t~)  ,  should  lead  to  an 
exponential  approximation  that  performs  especially  well  near  r-~ 
although  perhaps  less  well  further  away.  Again  it  is  convenient  to 
select  an  analytical  form  for  w(t;r)  that  is  compatible  with  the 
Laplace  transform,  i.e.  involves  linear  combinations  of  exponentials. 
An  example  is  the  density  function  of  exponential  order  statistics; 
this  device  was  used  in  a  numerical  transform  inversion  scheme 
(Gaver^®;  Gaver  and  Jacobs^  mention  the  idea  in  the  present  context). 
Here  is  a  specific  example  of  weighting.  Let 

w  ( t ;  r )  =  Se'.c'Ml-.''1)  =  3  (e'3,Ve‘3'%)  (3.9) 

where  u  =  .  Then  minimization  leads  first  to 

or 

|~  =  (e(t)-ae*/?t)e'^t-3(e  2A%-e  3/%)dt  =  0 

which  gives 

e  (/?+2/j)  -  e(/?+ 3M)  -  *(5^  ~  2?fe)  =  0  (3'10) 


or 


«o(/?) 


e  (  /?+2/j) 

1/ (2/?+2/i) 


[e  (0+2/0 


-  e  (  d+3/i) 


-  1/ (2^+3/i) 

_  e  ( d+3/x)  ]  C2^_2JLK2/?,+3,_)  _ 


(3.11) 
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Squaring  and  omitting  the  term  in  e2(t)  delivers 


-A  (a0  (/?),/?)  =  A  (/?)  =  (2/1+2/i)  (2/?+3g  )  [e  (/1+2/i) -e  (/l+3/i)  ]  2  ,  (3.12) 


which  can  be  easily  searched  for  a  global  maximum.  The  estimation 
procedure  is  tuned  towards  r  =  ^  in  this  case.  A  sharper  tuning  can 
be  accomplished  by  a  weight  function  that  concentrates  more  tightly 
around  r  than  does  (3.9) ;  the  latter  is  recognizably  the  density  of  the 
median  of  a  sample  of  size  3  from  an  exponential  df.  If  w  is  the 
density  of  the  mth  order  statistic  of  a  sample  of  n  exponentials  then 

+  •••  +  n^+i]  ~  i  ln(1  _  B)  and  its 


its  mean  is 


1 


n  +  n  - 1 


variance  is 


1 


m-  1 


-  — - — v  if  m  is  proportional  to  n.  As  n  increases  the  density 

;i2  n  (n-m+1 )  1  K  J 

function  of  w  =  wn  approaches  a  Gaussian/Normal  density  with  variance 
decreasing  like  1/n,  which  is  essentially  a  delta  function  at  r  as  n 


oo  . 


3 . 2  Method  2:  Derivative  Matching:  Exploiting  Random  Observation 
Times  (ROBS) . 

Since  it  is  proposed  to  approximate  e(t)  =  A(t)-A(oo)  by  ae  and 
since  the  transforms  of  both  sides  are  known  (or  can  be  estimated  from 
data)  one  may  contemplate  determining  n  and  0  as  the  solution  of 


e  (r)  = 


e  U/r[A(u) -A(oc)]  ^  =  |A(l/r)-A(oo) 


du  -  1  a 


OO 


-u/r  -/lu  du  =  _J_  . 

r  1  +/lr  ’ 


(3.13) 


that  is,  the  system  is  observed  at  a  random  exponent ial  time  having 
mean  r.  Cine  choice  for  r  i  s  t.  .  Obviously  any  n,  li  so  found  must 


1  6 


implicitly  depend  upon  r;  in  many  situations  for  which  the  exponential 
is  nearly  correct  the  dependency  of  0  and  a  on  T  will  be  gentle.  Here 
are  two  der  i  vat  i  ve- 1  i  ke  prescriptions  for  finding  n(r),  /?(r): 

(a)  Solve 


5  +  5 (r  +  A)  =  r  (r  +  A)  =  l/e(r  +  A) 

5  +  5 ( r  "  A)  =  r  ( r  -  A)  =  l/e(r  -  A) 


(3 . 14s! 


for  a  =  a(r;A),  0  -  0 (t ; A). 

(b)  Invert  and  analytically  differentiate  at  an  interesting  /"-value 


r(r)  =  ^ - - -  =  5  +  5  T 

A  (  1  /r)  -  rA  (oo) 


(3.15) 


r'(r)  =  g  . 


(3.16) 


Now  solve  simultaneously  for  0 (r) ,  o(r).  A  good  diagnostic  step  is 

to  plot  a(r )  and  0 (r )  vs.  r;  if  the  plots  are  nearly  constant  with  r 
then  the  exponential  provides  a  useful  form;  if  the  change  is  gradual 
it  can  potentially  be  represented  by  an  empirical  function,  e.g.  a  low- 
order  polynomial. 

It  is  also  possible  to  match  the  exponential  approximation  by  r- 
tuning,  as  was  done  by  the  weighting  procedure  of  (3.7).  Simply 
obse rve  the  system  with  probability  density 

w  ( t :  r )  =c(n,m)(l-e^t)m‘1e^lt^(e^t)n~m  ;  (3.17) 

it  is  convenient  to  take  n  odd  and  m  =  [n/2]  . 
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3.3  Method  3:  Matching  Transform  Means. 

The  following  procedure  represents  another  possibility  for 
assessing  /3 .  Put  a  =  1  -  A(oo)  and  write 

A  ( t )  =  A  (oo)  +  (1  -  A  (oo)  )  P  (t )  (3.18) 

and,  denoting  the  transform  of  P  by  p, 

..oo 

se"st  A(t)dt  =  sA(s)  =  A(oo)  +  (1  -  A(oo))sp(s) 

n 

(3.19) 


Note  that  if 


A  ( t )  -  A  (oo)  -dt 

1  -  A  (oo)  “  C 


then  transformation  yields 


sp(s) 


1 

i  +  nk) 


(3.20) 


or 


C1  +  0(g)] sp(s)  =  1 , 


(3.21) 


SO 


1  -  sp(s) 

P(») 


(3.22) 
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To  explicate  the  behavior  of  0  for  large  t,  expand  (3.22)  in  powers  of 
s  for  s  smal 1 : 


s[l  -  sA  (  s)  ] 
sA  (s)  -  A(oo) 

sE[C]{Fc(s)  -  Fu(s)> _ 

E[C][1  -  Fu(s)]  -  E[U][1  -  Fc(s)] 


(3.23) 


sE[C]{-s(E[C]-E[U]  )  +  ^(E[C2J-E[U2])+o(s2)} 
E[C]{sE[U]  -  ^E[U2]}  -  E[U]{sE[C]  -  ^E  [C2]  }+o  ( s2) 


Thus  . 


nm  3( s)  =  .-2ejcj  ielci  mn  . 

s  —  0  1  j  E[C2]E[U]  -  E[C]E[U2] 


(3.24) 


It  is  anticipated  that  this  expression  is  useful  when  t  becomes  large, 
provided  a  simple  exponential  is  an  appropriate  approximation. 

We  will  evaluate  (3.22)  for  s  —  1/t,  t  being  the  time  of  interest. 
It  is  also  possible  to  tune  this  procedure  to  a  time  t  as  before.  In 
particular,  setting 


pOO 

w(t :  r) 

0 


( A  ( t )  -  A(oo)i 

l  l-A(oo)  / 


dt 


w (t ; r) e 


-0t 


(3.25) 


?>nd  solving  for  0  where,  for  example,  w  is  as  in  (3.9)  .  This  tactic 
vi 1 1  be  employed  for  inferential  purposes  in  Section  5  with  w(t;r)  of 
the  form  in  (3.9). 


t 
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4.  TIME- DEPENDENT  APPROACH  CHARACTERISTICS  ASSESSED  FROM  DATA. 

In  this  section  we  examine  situations  reasonably  represented  as 
indicated  previously,  but  for  which  limited  information  on  the  up  and 

I 

down  times  is  available:  only  samples  of  finite  sizes  nu  for  the  up 

times  and  nd  for  the  down  times  are  at  hand.  Furthermore  it  is  desired 
to  avo id  using  particular  conventional  analytical  forms  for  the 

I 

underlying  distributions;  instead  ”  non-paramet  r  i  c”  or  ’’distribution- 
f ree”  methods  will  be  invoked.  Finally,  the  availability  at  a  finite 
time  after  an  initial  moment  is  of  interest. 

I 

4 . 1  Predicting  Availability  Assuming  EROBS :  Point  and  Interval 

Est i mates . 

Suppose  we  wish  to  estimate  the  availability  of  a  Model  1-type 

I 

system  at  a  random  (exponential)  time  with  mean  r,  i.e.  assuming  EROBS. 

Data  are  available  on  the  up  times  and  down  times: 

14  ,  n 2  >  ■  •  •  Unu  * 

I 

d l  <  <^2  ’  •  •  •  >  dnd 

are  the  respective  observations;  although  the  order  of  observation  is 
u1  ,  dj^,  u2  ,  d2,  •••  etc.,  it  will  fi  rst  be  assumed  that  the  Uj  ’  s  and  dj  ’  s 

I 

are  independently  sampled  from  fixed  distributions  Fy  and  FD ,  but  the 
latter  process  is  otherwise  unspecified. 

A  natural  non - paramet r i c  procedure  is  to  define  the  sample  or 

I 

empirical  transforms 


i  nu  -su, 

<MS)  =  nu  Y  ° 

i  =  l 


bD(s) 


(4.1) 


and  to  ut  il i ze  these  in  place  of  the  population  or  true  transforms  that 
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appear  in  (2.4)  as  a  solution  to  the  problem  posed, 
parametric  estimate  of  the  desired  availability  is 


Thus  a  non- 


E[A(T)]  =  a0(r)  = 


1  -  <Mr~1) 
i  - 


(4.2) 


Notice  that  the  up  and  down  times  are  conveniently  assumed  independent 
here.  Procedures  to  deal  with  more  complex  models  can  and  should  be 
devised;  accommodation  to  possible  up  and  down  data  dependencies  is  a 
natural  step,  first  by  graphics  and  subsequently  by  model  fitting  and 
test i ng . 

There  are  various  options  for  estimating  the  sampling  variability 
of  the  estimate  (4.2)  given  the  basic  model.  A  classical  procedure, 
adopted  here,  is  to  first  note  that  under  our  assumptions  both  4>u  ( s ) 
and  4>d(s)  are  asymptotically  Gaussian/Normal  by  the  central  limit 
theorem,  for  they  are  seen  to  be  (modelled  as)  averages  of  independent 
and  even  bounded  random  variables  e~s^  ,  e"s^ ;  s  =  1/r  >  0.  We  find 
easily  that  the  corresponding  random  variables  <t>u  ( s )  ,  dD  ( s )  are 
approximately  distributed  as  follows: 


d>u{s) 


dD  (s) 


n(pu(s),  <Wa.)  -„/»(•)>»)  , 


(4  .U) 


Since  a0(r)  is  a  probability,  confined  between 
reasonable  to  carry  out  further  asymptotics  on 
choose  to  study  the  logistic  transformation 


zero  and  one,  it  is 
a  t  ransformat  ion  :  we 


I  ( t )  =  In 


a00) 


1-a-oO) 


=  li 


l-^u(s) 


^*U  (  s  )  ( 1  ~^D  (  s  )  ) 


(4.4)  I 


=  In  [l-«iu(s)]  -  In  ^(s)  -  ln[l-^D(s)] 


Expand  in  Taylor  series  (the  delta  method)  to  obtain 


E[£(r)]  ~  1, 


ao  ( r ) 


l-a0(r) 


+  i 


1"2FU  y  _  r  A  1  i  1  Va-r[^D] 

—  —  Yar|>uJ  +  2 - 


1  n 


a0(r) 


1  -a0  (r) 


+  k 


(d-Fu)Fu) 

!-2*u _ U2/n  , 

^u/nu 


(i-fdv 


sn/nc 


2\'(  1  -d>p  )  0(j) 


(4.5) 


where  we  have  replaced  Fy  and  Fp  by  their  estimates  4>u  and  <6p  in  the 
correction  term.  Furthermore, 


Var[£(r)]  ~  —— O-——  Var[^]  +  jr~ ,2  Var  M 


su /nu  ,  ^d/nd  _  2 


(<$u ( 1  -^u) ) 


2  -  s£ 


(4.6) 


We  have  put 


„2  _  1  ^  /_-su,  .  )2 
~  rTu  —  r  I  *  M 


i=l 


and 


(4.7) 


2  1  ^  {  s<)i  )2 

■’1  =  S7^~T  7,  (°  ■  °“)  • 


Finally,  approximate  a  - 1 00%  con  fidoiH'f’  limits  are  given  by 


•)9 


t*  + 


Zq/2  •  s£  <  ln[a0(r)/(l-a0(r))]  <  «*  +  zX-a/&Sl 


(4.8) 


and 


n( 


1  -<t> li  (  1/r) 


2 


<*u(1/T)  O-^dC1/7-))/  2\h  (i-^u)«i,u) 


1  —  2  d>u 


\ 

l)  nu 


+ 


(1-*D)2 


(4.9) 


while  s£  =  ^ 


o 

from  (4.6)  .  The  expression  (4.8)  is  "then  inverted  t 


provide  two-sided  confidence  limits  for  the  actual  availability.  A 
numerical  example  is  provided  in  a  later  section. 

4.2  Predicting  Ava i 1 ab i 1 i ty  Semi-Parametrical ly  at  Fixed  Time 
(According  to  FOBS). 

Utilize  the  same  data  as  that  in  section  4.1  but  suppose  we  wish 
to  estimate 


A  ( t  )  ~  A  (  oe )  +  a  e 


■0t 


(4.10) 


After  some  experimentation  it  has  been  found  that  Method  8  above  can  be 
most  easily  and  effectively  adopted  to  estimate  3  and  a:  in  (3.18)  put 


A  (  oo)  = 

it  +  d 


(4.11  1 


find  est  i  mat  e  3  by  evaluating  the  empirical  version  of  (.3.22)  .  In  the 
simplest  case  (Model  1).  the  empirical  version  of  p(s)  is  given  by 


1  _  n 

i  -  c>c  ( is )  n  +  d 


i  i . 


11  4-  <1 


sp  (  s  ) 


so  the  estimator  of  (3.22)  is 


3e  (s) 


1  -  sp(s) 
P(s) 


Sett i ng 


w(t  ;  r) 


-2/it  -3/it 

3/i(e  -  e  ) 


in  (3.25)  results  in  the  equation 


3/i  [p  (2/i)  -  p  (3/i)  ]  =  3/i  [(2~  +  +  J) 


(4 . 13) 


or 


+  5„3  +  6/  -  p(2y)  K3))  =  0  (4.14) 

a  quadratic  in  3.  The  positive  solution  to  (4.14),  3q ,  gives  another 
estimate  of  3: 


3q  =  r>C-5^  +  >  ^  +  4/'[p(^/0  -  P  (3/*)  ] -1] 


(4.15) 


where  //  =  .  In  practice  3  q  may  occasionally  be  negative  or  imagi¬ 

nary,  in  which  case  a  reasonable  alternative  is  required.  In  our  simu¬ 
lation,  tests  of  the  procedure  defaulted  to  an  est imate  appropriate  for 
I'.D  independent  and  exponentially  d i st r i  but  ed  ,  i.e.  3  =  +  i^.  How¬ 

ever  in  general  a  non-positive  3  may  indicate  i nappropr i at 


of  the 


exponent ial -approach  model  (4.10)  so  a  problem-dependent  alternative 
must  be  sought . 

The  asymptotic  behavior  of  the  proposed  estimates  is  not  explored 
here.  In  the  following  section  we  describe  bootstrapping  (sample  re¬ 
use)  procedures  and  results  for  accessing  sampling  variability  of 
estimates  of  A(t)  and  /? . 
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5.  NUMERICAL  ILLUSTRATIONS  BY  SIMULATION. 

The  procedures  described  earlier  will  now  be  illustrated,  and  to 
some  degree  tested,  using  simulated  data. 

5.1  Predicting  Availability  under  EROBS :  Illustrations 

-  I 

Refer  to  Section  (4.1)  for  t'.e  basic  approach  to  be  utilized. 

Suppose  that  nu  =  nd  observations  are  available  on  iid  exponentially 
distributed  up  and  down  time  random  variables;  E [U]  =  1 ,  E [D]  =  4. 

| 

These  data  are  to  be  processed  utilizing  expressions  (4.8)  and  (4.9). 

To  do  so,  a  total  of  ns  =  500  independent  simulations  were  carried  out 
for  the  cases  nu  =  nd  =  n  =  10,  and  nu  —  nd  =  n  =  25.  In  Table  5.1  are 

I 

reported  the  mean  values  of  the  estimates  of  availability  at  an 
exponential  time  with  various  means  r.  Results  on  95%  confidence 
levels  a» e  also  given  (average  values  in  parentheses). 

I 

In  order  that  the  point  and  interval  estimates  behave  as  well  as 
they  do  for  small  samples  (n  ss  10)  the  bias  correction  recognizable  in 
(4.9)  is  required,  and  the  normal  percent-points  are  best  replaced  by 

I 

Student  t  percent-points  with  n-1  degrees  of  freedom.  An  alternative 
to  the  above  procedures  is  to  apply  the  jackknife;  see  Gaver  and  Chu^. 

Howevei ,  the  present  method  is  perhaps  more  easily  carried  out  on  small 

I 

computers  utilizing  nominal  confidence  levels  (l-a)-100%.  The  fraction 
of  the  confidence  limits  covering/surrounding  true  availability  at  r 
was  tabulated,  as  were  the  mean  upper  and  lower  confidence  1 imits  on 

I 

availability.  The  following  table  provides  a  summary  of  the  results; 
as  can  be  seen  the  coverage  is  close  to  the  nominal  95%. 
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Tab  1 e  5.1 


Coverage  and  Mean  Confidence  Limits,  EROBS 
Nominal  Confidence  Level  95% 
r- Val ues 

0.125  1.00  10.00 

True:  (lower)  0.92  (upper)  (lower)  0.83  (upper)  (lower)  0.80  (upper) 

Availability:  Estimated:  (0.71)  0.90  (0.96)  (0.66)  0.84  (0.93)  (0.63)  0.81  (0.91) 

(n  =  10) 

Coverage  (%)  94  96  94 

Availability:  Estimated  (0.82)  0.93  (0.97)  (0.74)  0.83  (0.90)  (0.70)  0.80  (0.88) 

(n  =  25) 

Coverage  (%)  93  97  96 

The  figures  in  parentheses  represent  mean  upper  and  lower  confidence 
limits;  notice  that,  as  anticipated,  these  tend  to  move  towards  the 
true  values  as  the  sample  size  increases. 

5.2  P redicting  Availability  under  FOBS:  Illustrations 

Again  we  use  simulation  to  assess  the  accuracy  of  the  proposed 
exponential  approx i mat i ons  given  in  Section  3. 

It  has  been  found  experimentally  that  the  empirical-transform- 
adapted  least-squares  approaches  of  Section  3.1  tend  to  be  numerically 
unstable  for  small  sample  sizes;  they  behave  well  when  component  models 
are  assumed  perfectly  specified  (’’known”)  or  for  very  large  sample 
sizes.  On  the  other  hand.  Method  3  of  Section  3.3,  adapted  to  the 
empirical  transform  as  outlined  in  Section  4.2,  performs  satisfactorily 
for  the  various  cases  considered  and  is  not  computationally  intensive . 

Simula! ion  results  for  three  different  estimators  for  A(t)  are 
reported .  The  estimators  are  all  of  the  form 

A  ( t  )  =  7T  +  (  1  -  w )  e  (5.1) 
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where 


u  +  d 


The  estimators  differ  in  the  manner  in  which  0  is  estimated.  The  first 


estimate,  Ap(t),  estimates  0  by 


dp  =  (IT1  +  d'1)  . 


(5.2) 


Note  that  Ap(t)  is  the  estimator  that  would  be  obtained  if  it  were 
simply  assumed  that  {Uj}  and  {Dj}  are  independent  sequences  of 
independent  exponential  random  variables  and  maximum  likelihood  is  used 
to  obtain  estimates  of  A(t),  i.e.  if  the  simplest  Markov  model  were 
automatically  invoked.  The  second  estimator,  Ae(t) ,  estimates  0  as  in 
(4.13)  with  s  =  i.  The  third  estimator,  Aq(t),  estimates  0  as  in 


(4.15)  with  /i  =  =1} 


If  the  estimated  /?  ’  s  are  negative  then  0  is  set 


equal  to  0D  ,  the  MLE  estimator  of  0  if  it  were  known  that  {Uj}  and  {Dj} 
are  independent  sequences  of  independent  identically  distributed 
exponential  random  variables.  In  our  experience  such  pathological 
cases  are  rare . 

All  simulations  were  done  on  an  IBM  3033  AP  at  the  Naval 
Postgraduate  School  using  the  LLRANDOMII  random  number  generating 
package ;  Lewis  and  Uribe* 1 .  The  simulations  reported  in  Tables  (5.2) 
and  (5.3)  have  500  replications.  Generated  in  each  replication  is  a, 
sample  of  nu  =  25  up  times  and  nd  =  25  down  times.  In  the  experiment 
reported  in  Table  (5.2)  the  up  times  and  down  times  are  independent. 
Three  distributions  are  used  to  generate  the  down  1  imes: 
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Table  5.2 


Estimates  of  Availability 
Independent  Up  and  Down  Times 


Time  Dist 

True 

fip 

Ap(t) 

fie 

Ae 

(t) 

fio, 

Aq(t) 

A(t) 

Mean 

Var 

Mean 

MSE 

Mean 

Var 

Mean 

MSE 

Mean 

Var 

Mean  MSE 

(Median) 

(Median) 

(Median) 

.2 

A 

.83 

3.1 

.14 

.85 

.03 

3.8 

4.2 

.83 

.06 

3.8 

4.7 

.83 

.06 

(3.1) 

(3.4) 

(3.4) 

.5 

(Gamma) 

.71 

3.1 

.14 

.74 

.05 

4.6 

34 

.72 

.06 

4.5 

23 

.72 

.06 

(3.1) 

(3.6) 

(3.7) 

1.0 

.67 

3.1 

.14 

.68 

.05 

4.7 

48 

.68 

.05 

4.6 

23 

.68 

.05 

(3.1) 

(3.6) 

(3.5) 

.2 

B 

.85 

3.1 

.23 

.85 

.03 

3.4 

3.2 

.85 

.05 

3.3 

3.1 

.85 

.06 

(3.1) 

(3.0) 

(3-0) 

.5 

(Exp) 

.74 

3.1 

.23 

.74 

.04 

3.5 

4.7 

.74 

.06 

3.5 

4.7 

.74 

.06 

(3.1) 

(3.0) 

(3.0) 

1.0 

.68 

3.1 

.23 

.68 

.05 

3.7 

14 

.69 

.06 

3.9 

18 

.69 

.06 

(3.1) 

(3.0) 

(3.0) 

.2 

C 

.90 

4.4 

6.7 

.86 

.06 

3.4 

38 

.91 

.03 

3.5 

52 

.91 

.03 

(3.4) 

(1.7) 

(1-8) 

.5 

(M.  Exp.) 

.87 

4.4 

6.7 

.77 

.13 

2.9 

57 

.87 

.04 

2.5 

14 

.87 

.04 

(3-4) 

(1-2) 

(1.2) 

1.0 

.84 

4.4 

6.7 

.72 

.17 

2.5 

26 

.82 

.06 

1.9 

6.1 

.83 

.06 

(3.4) 

(1.0) 

(.92) 

2.0 

.79 

4.4 

6.7 

.70 

.17 

2.5 

75 

.77 

.09 

1.8 

9.8 

.78 

.08 

(3.4) 

(-87) 

(-80) 

Table  5.3 


Estimates  of  Availability 
Dependent  Up  and  Down  Times 


4>c 

T  i  mo 

Case 

Tru  e 

fiq 

Aq 

(t) 

fiq 

A  q 

(t) 

A  ( t ) 

Mean 

Var 

Mean 

MSE 

Mean 

Var 

Mean 

MSE 

0.2 

DA 

.9-4 

3.  1 

1  .7 

.85 

.  10 

1  .0 

.  13 

.94 

.  02 

0.5 

.87 

3. 1 

1  .  1 

.  75 

.  13 

1 . 0 

.07 

.87 

.  03 

1 .0 

.79 

3.1 

1  .0 

.69 

.  1  1 

1 . 0 

.07 

.  79 

.  03 

2.0 

.72 

3.2 

1 .9 

.  67 

.05 

1  .  1 

.09 

.71 

.  02 

0.2 

DB 

.97 

3. 1 

14 

.91 

.07 

.73 

•5 . 1 

.97 

.  02 

0.5 

.93 

2.4 

1  1 

.87 

.07 

.83 

3.8 

.  93 

.  03 

1  .0 

.88 

2.0 

7.2 

.83 

.07 

.  79 

.  56 

.88 

.  05 

2.0 

.81 

1  .8 

8.0 

.78 

.08 

.83 

.  4  5 

.81 

.07 
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A: 

P{D 

> 

t}  =  1  -  e”4t  -  4te"4t  ,  t  >  0  ; 

(Gamma) 

B: 

P{D 

> 

t}  =  e'2t  ,  t  >  0  ; 

(Exponent i al ) 

C: 

P{D 

> 

t}  =  .  9e‘9t  +  .le' 251  ,  t  >  0  ; 

(Mixed  Exponential) 

The  up  times  are  generated  from  an  exponential  distribution  with  unit 
mean.  The  theoretical  values  of  A(t)  in  each  of  these  cases  are 


A: 

A  ( t )  = 

.67 

+ 

e"4  5t  [  .  33  cos(1.9t)  +  .26  sin(1.9t)]  ; 

(5.3) 

B: 

> 

/ — X 

c+ 

II 

.67 

+ 

.  33e"3t  ; 

(5.4) 

C: 

A  ( t )  = 

.67 

+ 

.  24e"  341  +  .  09e’9  9t  . 

(5.5) 

For  each  repl ication  of  the  simulations  whose  results  are  reported  in 
Table  (5.2)  the  three  estimates  of  A(t)  are  computed.  The  mean,  and 
mean  square  error  (MSF,),  of  Ap(t),  Ae(t)  and  Aq(t)  are  computed:  i.e. 

the  mean  is 


,  500  _ 

A,(t)  =  500  T,  A,(kit) 
k—  1 


(5.6) 


and 

,  500  „  , 

MSE  =  -frrx  £  ( Ae  ( k  :  t )  -  A(t))2  (5.7) 

OV(>  k=l 

where  Ae(k;t)  is  the  point  estimate  at  t  in  the  kth  realization. 
Furthermore,  the  mean  and  variance  of  the  estimates  of  ft  are  displayed. 

5 . 3  Discussion  of  Fables . 

Table  (5.2)  reports  results  for  simulations  with  data  sample  sizes 
25.  Not  surprisingly,  the  exponential  estimator  Ap(t)  has  means  equal 


to  the  values  of  A(t  )  and  the  sma  1  1  est  mean  square  error  in  the  case  B 


of  exponential  down  times.  The  means  of  Ap(t)  are  somewhat  different 
from  the  A(t)’s  in  case  A  (gamma  down  times)  and  quite  different  in 
case  C  (mixed  exponential  down  times).  The  estimators  Ae(t)  and  Aq(t) 
have  means  which  are  closer  to  the  A(t)’s  than  those  of  Ap(t)  in  cases 
A  and  C.  The  means  of  Ae(t)  and  Aq(t)  are  a  bit  low  for  t  =  1 ,  2  in 
case  C.  In  cases  A  and  B  the  values  of  the  MSE  of  Ae(t)  and  Aq(t) 
indicate  the  greater  variability  of  these  estimators.  In  the 
exponential  case  B,  the  true  value  of  0  is  3;  the  estimator  0p  has 
means  closest  to  3  for  case  B  and  much  smaller  variances  compared  to  0e 
and  0q .  In  the  other  two  cases  p(t)  is  not  of  the  form  e  ^ ;  the 
theoretical  values  of  A(t)  are  given  in  (5.3)  and  (5.5) . 

In  case  A  (gamma  distributed  down  times)  the  single  parameter,  0 , 
of  exponential  decay  is  4.5.  The  means  of  the  estimators,  0e  and  0q  are 
closer  to  this  value  than  those  of  0p.  In  case  C  of  mixed  exponential 
down  times,  the  smallest  parameter  of  exponential  decay  is  0.341.  Once 
again  the  means  of  0e  and  0q  are  closer  to  this  value  than  are  those  of 
dp-  The  variances  of  0q  and  0e  for  the  sample  size  of  25  can  be  large. 
In  many  cases  the  variance  of  0Q  is  less  than  that  for  /?e  •  Increasing 
the  sample  size  decreases  the  variances,  as  is  anticipated. 

Table  (5.3)  summarizes  a  simulation  study  of  the  procedure  of 
Section  4.2  in  two  cases  in  which  the  pairs  (U|,D|)  are  independently 
and  identically  distributed  with  Uj  and  D|  perfectly  dependent.  The  two 
cases  are : 

DA:  Uj  =  Ej  and  D|  =  with  {Ej}  independent  identically 


d ’ s t r i bu ted 

ex pone n tials 

with 

unit 

mean  . 

wit  ii 

probab i 1 i ty 

.9, 

DB :  Vt 

=  Ej  and  D(  = 

IlEj 

w  i  t  h 

probab i 1 i ty 

.  1 
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with  {Ej}  independent  exponential  random  variables  with  unit  mean.  In 
case  DA 


A  ( t )  = 


2  +  1  e'1 

3  +  3 


(5.8) 


In  case  DB 


A  (t )  =  4  +  0.11  e"‘  +  0 . 22e' 


(5.9) 


In  the  simulations  two  estimators  for  Fc(s)  are  used.  The  first 
(incorrectly)  assumes  that  {Uj}-  and  {Dj}  are  independent  and  uses 
<^u(s)</>D(s)  to  estimate  Fc(s).  The  second  does  not  assume  independence 
and  instead  estimates  Fc(s)  by 


-it5  -s[u,+dj] 


<t> c(s>  =  it  L 


(5.10) 


The  table  shows  results  for  the  estimators  Aq(t)  and  /?q  .  The  sample 
size  is  25  and  there  are  500  replications. 

Table  (5.3)  informs  us  that  the  estimators  may  be  noticeably 
sensitive  to  the  choice  of  the  estimator  of  Fc(s)  .  If  Uj  and  D(  are 
dependent,  then  using  0u(s)bp(s)  to  estimate  Fc(s)  can  be  quite 
misleading.  As  a  result,  it  is  suggested  that  if  there  is  a 
possibility  that  Uj  and  Dj  may  be  dependent,  <j>c(s)  is  the  more  model- 
robust  estimate  of  Fc(s),  and  hence  of  the  desired  availabilities. 

Note  that  in  case  DA,  A(t)  has  exactly  the  presumed  form  of 
(4.10).  When  is  used  in  this  case,  the  mean  value  of  the  /)q  '  s  equal 

the  theoretical  value  of  unity  in  all  but  the  case  t  =  2.0.  In  case 
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DB ,  p(t)  is  actually  a  mixture  of  two  exponentials,  one  having  rate 
unity  and  the  other  having  rate  0.27;  when  </>c  is  being  used,  the  mean 
values  of  the  /?q  1  s  fall  between  the  two  correct  rates.  Emphasis  of 
either  rate,  and  the  corresponding  probability,  can  be  achieved  by 
we ight i ng . 

5 . 4  Sem i -Paramet r i c  Confidence  Intervals  Illustrated . 

Table  (5.4)  shows  bootstrap  confidence  intervals  for  Aq(t)  and  dq 
at  various  times.  A  single  sample  of  25  up  times  and  25  down  times  is 
generated  by  simulation.  The  up  times  are  independent  with  unit-mean 
exponential  distribution;  th'_y  are  independent  of  the  ^^wn  times.  The 
down  times  are  independent  with  the  gamma  distribution,  case  B.  One 
hundred  bootstrap  replications  were  then  carried  out  and  Aq  and  /?q  are 
computed  for  each  replication.  Both  estimators  of  Fc(s),  bp  ( s)  <t>o  ( s) 
and  bc(s),  are  used.  Table  (5.4)  exhibits  the  5th,  50t,h  ,  and  95th 
order  statistics  of  the  estimates  which  give  95%  confidence  intervals 
of  the  parameters. 

All  confidence  intervals  for  dq  cover  the  true  values  for  the 
particular  sample  utilized.  The  confidence  intervals  for  dq  cover  the 
exponential  decay  parameter  of  value  4.5,  for  the  gamma  case.  The 
confidence  intervals  for  Aq(t)  are  the  same  for  both  methods  of 
estimating  Fc(s)  suggesting  that  not  much  is  lost  by  using  d>(-  ( s )  to 
estimate  F<-(s)  in  the  independent  case.  As  a  result,  it  is  suggested 
that  if  there  is  a  possibility  that  {Uj}  and  {D|}  may  be  dependent  t.  hen 
( s )  is  the  more  robust  estimate  of  Fc(s) . 

A  similar  bootstrap  experiment  was  carried  out  with  a  single 
sample  of  25  up  t  imes  and  25  down  times  generated  f ram  mode]  DA  in 
which  the  up  and  down  times  are  dependent.  One  hundred  bootstrap 


Tab 1 e  5.4 


Bootstrap  Confidence  Intervals 
Gamma  Distributed  Down  Times 
Independent  Up  and  Down  Times 


Time 

True 

0 

q 

Aq 

(>) 

0 

q 

Aq 

(t) 

A(t) 

.05 

.50 

.95 

.05 

.50 

.95 

.05 

.50 

.95 

.05 

.50 

.95 

.2 

.83 

1.6 

4.1 

13.6 

.71 

.84 

.92 

1.6 

3.9 

11.8 

.71 

.84 

.92 

.5 

.71 

2.4 

4.1 

12.9 

.61 

.73 

.82 

2.4 

3.9 

9.8 

.61 

.73 

.82 

1 

.67 

2.3 

3.4 

16.3 

.58 

.71 

.79 

2.2 

3.4 

19.1 

.58 

.71 

.79 

replications  were  generated  and  Aq  and  0 q  computed  for  each  replication 
with  both  estimators  of  Fc(s).  Once  again  the  resulting  confidence 
i  ntor'al  s  for  A  ( t )  were  very  similar-  for  both  estimators  of  Fc(s). 

Of  course  the  above  results  are  quite  fragmentary,  but  seem  useful 
and  promising.  Further  sampling  experiments  and  asymptotic  y«ae® 

will  shed  more  light  on  the  behavior  of  the  estimating  procedures 
explored,  and  may  we  1  l  suggest  alternations  or  replacements. 


6.  CONCLUDING  COMMENTS. 

This  paper  argues  that  probability  models  of  the  availability  of 
various  systems  can  be  expressed  in  terms  of  Laplace  transforms,  and 
that  the  finite-time  behavior  of  such  systems  can  be  inferred,  nearly 
non - paramet r i cal  1 y ,  from  data.  Our  approach  has  been  to  invoke  the 
empirical  Laplace  transforms  and  to  utilize  its  easy  direct  interpreta¬ 
tion  (EROBS) ,  in  conjunction  with  a  presumed  approximate  exponential 
rate  of  approach  to  steady  state,  to  deduce  availability  at  a  fixed 
finite  time  after  a  known  initial  moment  (FOBS). 

The  methods  proposed  are  distinguished  by  their  simplicity  and 
moderate  computer  intensi vity  as  well  as  by  their  lack  of  direct 
dependence  upon  probability  models  in  “up”  and  “down”  times  selected 
from  conventional  families  such  as  the  Gamma.  Simulations  have  been 
used  to  evaluate  the  procedures  suggested,  and  to  provide  approximate 
confidence  limits,  either  by  asumptotics  (utilizing  the  approx i mate  1  y 
Norma  1 /Gauss i an  behavior  of  the  empirical  transform),  or  by  a  simple 
re -samp  ling,  Efron’s  bootstrap  .  In  pa.  Uvular,  we  have  examined  the 
effect  on  inference  quality  of  assuming  the  wrong  joint  probability 
model:  one  that  falaciously  assumes  independence  when  dependence 

(between  up  and  down  times)  is  actually  present. 

No  claim  is  made  that,  the  methods  proposed  here  are  the  best 
available:  in  fact  there  are  many  alternatives.  One  is  to  analytical ly 
invert  the  empirical  transform  of  availability  possibly  by  use  of  the 
Stehfert  algorithm^  ,  although  competitors  are  available.  Another  is 
to  bootstrap  directly;  the  latter  exercise  involves  re-sampling  up  and 
down  times  from  the  observed  data,  to  reconstruct  the  sample  path  of 
the  process,  and  to  score  1  at  t  i me  t  if  an  up  t i me  covers  t.  otherwise 
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score  0.  Finally,  A(t)  is  estimated  by  the  proportion  of  (re)samples 
that  count  1.  Confidence  1 imits  are  available  from  the  basic  bootstrap 
technology.  The  direct  bootstrap  approach  is  being  investigated  by 
l.ee"^  .  Another  option  is  to  replace  the  distribution  "functions  in  the 
renewal  equations  for  availability  by  their  empirical  counterparts  and 
numerically  solve  the  empirical  renewal  ( Vo  1  to r ra- type )  equations,  with 
subsequent,  bootstrap  follow-ups  to  assess  uncertainty.  All  such 
methods  promise  to  be  far  more  computationally  intensive  than  our 
present  approximate  approaches.  Their  invest  i gat i on  has  been  deferred. 
Appl  i cat  ion  of  our  approximation  procedure  to  infer  t he  M/C/l  queue 
finite-time  behavior  is  under  wa\' :  Jacobs  and  flavor^  '  . 
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